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1.153 (Design) Application 

Pages of Specification 

06 Pages of Claims 
14 Sheets of Drawing 
I I Formal 
Informal 

□ The enclosed drawing(s) are photograph(s), and there is also attached a "PETITION 
TO ACCEPT PHOTOGRAPH(S) AS DRAWING(S)." 37 C.F.R. § 1.84(b). 
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5. Declaration or Oath (including power of attorney) 

I I Enclosed 

Executed by 

I I inventor(s). 

I I legal representative of inventor(s). 37 C.F.R. § 1.42 or 1.43. 
I I joint inventor or person showing a proprietary interest on behalf of inventor 
who refused to sign or cannot be reached. 

I~l This is the petition required by 37 C.F.R. § 1 .47 and the statement 
required by 37 C.F.R. § 1.47 is also attached. See item 13 below for 
fee. 

[X] Not Enclosed. 

I I Application is made by a person authorized under 37 C.F.R. 1.41(c) on 
behalf of all the above named inventor(s). 
I I Showing that the filing is authorized. 

(not required unless called into question, 37 C.F.R. § 1.41(d)) 

6. Inventorship Statement 

The inventorship for all the claims in this application are: 
l~l The same. 

or 

I I Not the same. An explanation, including the ownership of the various claims at the 
time the last claimed invention was made, 
I I is submitted. 
I I will be submitted. 

7. Language 

[El English 

I I Non-English 

I I The attached translation includes a statement that the translation is accurate. 
37 C.F.R. § 1.52(d). 

8. Assignment 

I I An assignment of the invention to 

□ is attached. A separate □ "COVER SHEET FOR ASSIGNMENT (DOCU- 
MENT) ACCOMPANYING NEW PATENT APPLICATION" or [ ] 
FORM PTO 1595 is also attached. 

M will follow. 



(Application Transmittal - Page 3 of 6) 



Attorney Docket No. 80 1 1 3-0 1 03 
Express Mail Label No. EL 686849566 US 



9. Certified Copy 

Certified copy(ies) of application(s) 



country appln. no. 


filed 




country appln. no. 


filed 




country appln. no. 


filed 




from which priority is claimed 
1 1 is (are) attached. 
1 I will follow. 






10. Fee Calculation (37 C.F.R. § 1.16) 






A. IXI Regular application 






CLAIMS AS FILED 


Number Filed Number Extra Rate 


Basic Fee 
37 CFR 1.16(a) 
$ 710.00 


Total Claims 

(37 CFR 1.16(c) 35-20 = 15 X $18.00 




270.00 


Independent Claims 

(37 CFR 1.16(b)) 3-3 = 0 X $80.00 




O 


Multiple dependent 
claims, if any, 

(37 CFR 1 .1 6(d)) X $ 270.00 


I I Amendment cancelling extra claims is enclosed. 

I I Amendment deleting multiple-dependencies is enclosed. 

I I Fee for extra claims is not being paid at this time. 
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1 1 . Small Entity Statement(s) 



I I Statement(s) that this is a filing by a small entity under 37 C.F.R. §§ 1.9 and 1.27 is 
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I I Status as a small entity was claimed in prior application , 

filed on from which benefit is being claimed for this application under: 

35U.S.C.§ □ 119(e), 

□ 120, 

□ 121, 

□ 365(c), 

and which status as a small entity is still proper and desired. 

I I A copy of the statement in the prior application is included. 

Filing Fee Calculation (50% of A, B or C above) $ 

12. Request for International-Type Search (37 C.F.R. § 1 . 1 04(d)) 

I I Please prepare an international-type search report for this application at the time when 
national examination on the merits takes place. 

13. Fee Payment Being Made at This Time 
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I I No filing fee is to be paid at this time. 

(This and the surcharge required by 37 C.F.R. § 1.16(e) can be paid 
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Filing fee $ 980.00 
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ASSIGNMENT ACCOMPANYING NEW 

APPLICATION.") $ 
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or person on behalf of the inventor where inventor 
refused to sign or cannot be reached 

(S130.00; 37 C.F.R. §§ 1.47 and 1.17(i)) $ 

□ For processing an application with a 
specification in a non-English language 

($130.00; 37 C.F.R. §§ 1.52(d) and 1.17(k)) $ 

I I Processing and retention fee 

($130.00; 37 C.F.R. §§ 1.53(d) and 1.21(1)) $ 

I I Fee for international-type search report 

($40.00; 37 C.F.R. § 1.21(e)) $ 

Total Fees Enclosed $ 980.00 
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15. Authorization to Charge Additional Fees 

^ The Commissioner is hereby authorized to charge the following additional fees by this 
paper and during the entire pendency of this application to Account No. 18-0013. 
E\ 37 C.F.R. § 1.16(a), (f) or (g) (filing fees) 
1X1 37 C.F.R. § 1.16(b), (c) and (d) (presentation of extra claims) 
1X1 37 C.F.R. § 1.16(e) (surcharge for filing the basic filing fee and/or declaration 

on a date later than the filing date of the application) 
[El 37 C.F.R. § 1.17(a)(l)-(5) (extension fees pursuant to § 1.136(a). 
1X1 37 C.F.R. § 1.17 (application processing fees) 

1 1 37 C.F.R. § 1.18 (issue fee at or before mailing of Notice of Allowance, 
pursuant to 37 C.F.R. § 1.31 1(b)) 
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13 Credit Account No. 18-0013. 
□ Refund. 
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Tel. No.: (248) 594-0645 
Customer No. 010291 
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Application(s) Claimed 
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I 1 Plus added pages deleting names of inventor(s) named on prior application(s) who 
is/are no longer inventor(s) of the subject matter claimed in this application. 
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1 I Plus "Assignment Cover Letter Accompanying New Application" 

Number of pages added 

["I Statement Where No Further Pages Added 

I 1 This transmittal ends with this page. 
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ADDED PAGES FOR APPLICATION TRANSMITTAL WHERE BENEFIT OF 
PRIOR U.S. APPLICATION(S) CLAIMED 



17. Relate Back 

EX] Amend the specification by inserting, before the first line, the following sentence: 

A. 35 U.S.C. 119(e) 

[>3 "This application claims the benefit of U.S. Provisional Application(s) No(s).: 

APPLICATION NO(S).: FILING DATE 

60/158,032 10/7/99 

B. 35 U.S.C. 120, 121 and 365(c) 

I I "This application is a 

I I continuation 

I I continuation-in-part 

I I divisional 

of copending application(s) 

I I application number filed on 



□ International Application filed on and which designated the U.S." 

□ "The nonprovisional application designated above, namely application 

, filed , claims the benefit of U.S. Provisional Application(s) No(s).: 

APPLICATION NO(S).: FILING DATE 



|~| Where more than one reference is made above please combine all references into one sentence. 



18. Relate Back— 35 U.S.C. 119 Priority Claim for Prior Application 

The prior U.S. application(s), including any prior International Application designating the U.S., 
identified above in item 17B, in turn itself claim(s) foreign priority(ies) as follows: 



Country Appln. no. Filed 
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The certified copy(ies) has (have) 

I | been filed on , in prior application , which was filed on 

I I is (are) attached. 



19. Maintenance of Copendency of Prior Application 

A. O Extension of time in prior application 

(This item must be completed and the papers filed in the prior application, if the period set in the 

prior application has run.) 

fl A petition, fee and response extends the term in the pending prior application until 

I | A copy of the petition filed in prior application is attached. 

B. O Conditional Petition for Extension of Time in Prior Application 

(complete this item, if previous item not applicable) 

|~| A conditional petition for extension of time is being filed in the pending prior application. 
PI A copy of the conditional petition filed in the prior application is attached. 

20. Further Inventorship Statement Where Benefit of Prior Application(s) Claimed 

(complete applicable item (a), (b) and/or (c) below) 

(a) □ This application discloses and claims only subject matter disclosed in the prior application 
whose particulars are set out above and the inventor(s) in this application are 

□ the same. 

□ less than those named in the prior application. It is requested that the following inventor(s) 

identified for the prior application be deleted: 



(type name(s) of inventor(s) to be deleted) 

(b) □ This application discloses and claims additional disclosure by amendment and a new 
declaration or oath is being filed. With respect to the prior application, the inventor(s) in 
this application are 

I I the same. 

I | the following additional inventor(s) have been added: 



(type name(s) of inventor (s) to be deleted) 
(c) □ The inventorship for all the claims in this application are 
□ the same. 

I | not the same. An explanation, including the ownership of the various claims at the time the 
last claimed invention was made 
I I is submitted. 
I I will be submitted. 
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21. Abandonment of Prior Application (if applicable) 

I | Please abandon the prior application at a time while the prior application is pending, or when 
the petition for extension of time or to revive in that application is granted, and when this 
application is granted a filing date, so as to make this application copending with said prior 
application. 

22. Petition for Suspension of Prosecution for the Time Necessary to File an Amendment 

I | There is provided herewith a Petition To Suspend Prosecution for the Time Necessary to File 
An Amendment (New Application Filed Concurrently) 

23. Small Entity (37 CFR § 1 .28(a)) 

□ Applicant has established small entity status by the filing of a statement in parent application 
on . 

I | A copy of the statement previously filed is included. 

24. NOTIFICATION IN PARENT APPLICATION OF THIS FILING 

I I A notification of the filing of this 
(check one of the following) 

I I continuation 

I I continuation-in-part 

I I divisional 

is being filed in the parent application, from which this application claims priority under 35 U.S.C. § 
120. 
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MULTI-TASKING MESSAGE EXTRACTOR 

REFERENCE TO RELATED APPLICATIONS 

This application claims the benefit of U.S. Provisional Application No. 
60/158,032, filed October 7, 1999, the disclosure of which is incorporated herein by 
reference in its entirety. 

TECHNICAL FIELD 

The present invention relates to the field of message extractors for extracting 
messages from an input data stream, and more particularly to a message extractor for use 
in higher-performance applications, such as head-end applications. 

BACKGROUND ART 

Application specific integrated circuits (ASICs) are often used to extract data, 
such as packet data, from data streams. Message extractors are often used in set-top 
devices for receiving cable signals to obtain video and audio data as well as subscriber 
information corresponding with a given set-top device. Head-end devices have many 
more functional requirements than basic set-top devices, including re-multiplexing, 
encryption, and decryption functions, and therefore require more message extractors to 
accommodate the increased number of functions. The re-multiplexing function in 
particular requires more message extractors in the ASIC because re-multiplexing requires 
the device to extract services and messages from a greater number of data streams and to 
combine them into different data streams. 

Adding more message extractors to accommodate the increased functional 
requirements of head-end devices, however, require additional ASIC space, on the order 
of 7-8K ASIC gates per message extractor. To conserve ASIC space while maintaining 
the re-multiplexing function, a processor that performs the re-multiplexing function may 
continuously reassign the message extractors to reference different packet identifiers at 
different times to extract the needed messages from the data stream. Using the processor 
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to reassign message extractors, however, reduces the amount of time that the processor 
can devote to perform core tasks related to the re-multiplexing process itself, reducing the 
speed at which messages are received and processed. 

There is a need for a device that can accommodate the greater message extraction 
5 requirements of head-end devices for, e.g., re-multiplexing, encryption and decryption, 
without consuming additional ASIC space or sacrificing processor speed. 

SUMMARY OF THE INVENTION 

Accordingly, the present invention is directed to a message extraction apparatus 
10 and method having improved message extraction capability. More particularly, the 

invention is directed to an apparatus for extracting messages from a digital data stream 
containing messages, comprising: a message processor that receives the digital data 
stream and extracts message portions from the digital data stream; a first buffer having a 
plurality of locations associated with a plurality of channels to store the extracted 
15 message portions; and a second buffer having a plurality of locations associated with the 
plurality of channels for storing state data corresponding to the extracted message 
portions. By extracting and storing the message portions and their associated state data in 
separate buffers, the system can assemble complete messages from multiple channels in a 
multiplexed fashion. 

20 One embodiment of the invention is directed to a device for extracting messages 

from a data stream, comprising: an input interface that receives packet data in the data 
stream; a packet identifier filter coupled to the input interface to selectively filter the 
packet data and having the packet identifier filter having a CPU interface to allow 
communication between the device and a CPU; and a message processor that receives the 

25 selectively filtered packet data from the packet identifier filter and that is configured as a 
plurality of channels. The embodiment also includes a first buffer for storing the 
extracted message portions and a second buffer that stores state data corresponding to the 
packet data being processed until an entire message has been completely processed, even 
if the components of the messages are distributed over multiple packets in the data 
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stream. The invention also includes a method for extracting messages from a data 
stream, storing message portions into an internal buffer, and storage message processor 
states corresponding to the message portions in an external buffer until an entire message 
has been processed. 

5 By storing the states and content of incomplete messages as they arrive in the 

packet data, the inventive system can process multiple messages without requiring 
multiple message extractors because the multi-tasking features of the inventive system 
store incomplete messages and their states as other messages are being processed and 
then reloads the incomplete message data at a later time to complete processing. The 

10 multi-tasking message extractor according to the present invention reduces the cost of 
performance by only requiring one message extractor attached to a less expensive RAM 
rather than multiple message extractors. 

BRIEF DESCRIPTION OF THE DRAWINGS 

15 Figures 1A is a representative block diagram of one embodiment of the inventive 

message processor; 

Figure IB is a block diagram of a central processing unit interface to be used in 
conjunction with the device shown in Figure 1; 

Figure 2 is a timing diagram illustrating re-synchronization of byte data before it 
20 is sent to filters in the inventive system; 

Figure 3 is a timing diagram illustrating the timing used to generate internal clock 
enable signals in the invention; 

Figures 4A and 4B are diagrams illustrating the memory structure and control 
structure of filters used in the invention; 
25 Figures 5A though 5D show various ways in which data packets can be shifted by 

the inventive device; 

Figure 6 is a state diagram illustrating the operation of the inventive message 
extractor; 
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Figure 7 is a diagram illustrating the RAM and address filter shift register in the 
message processor of the invention; 

Figure 8 is a diagram of an address filter control circuit in the invention; 

Figure 9 is a diagram of a CRC and error checking circuit in the invention; 
5 Figure 10 is a flowchart showing a process for controlling the reading of message 

buffers in the invention; 

Figure 1 1 is a message interrupt control diagram; and 

Figure 12 illustrates a message error control circuit. 

10 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The control message processor according to the present invention is preferably in 
the form of a programmable field gate array. The control message processor 
programmable field gate array (CMP-FPGA) is preferably designed to have features that 
would be compatible with head-end functional requirements. Generally, the purpose of 

15 the CMP-FPGA is to extract control messages out of a data stream, such as an MPEG 
input stream, store the messages in a message buffer store corresponding message states 
in a state buffer, and notify a central processing unit (CPU) that there are messages 
available for processing. More particularly, the CMP-FPGA according to the invention 
has one message processor shared among multiple channels, where every state of the 

20 message processor and all partially completed calculations are stored in a state buffer and 
where the extracted messages are stored in a message buffer. Both the state buffer and 
the message buffer are divided into a plurality of addressable portions, one portion per 
channel. The parameters for implementing message extraction features for head-end 
functions will first be described briefly and then the details of implementation will be 

25 described with respect to the Figures. A preferred CMP-FPGA according to the present 
invention filters messages in a data stream, such as an MPEG format video stream, rather 
than using software. The preferred features for address-type filtering include broadcast 
filtering and a filter provided for each channel in the CMP-FPGA for Unit Address 40, 
Network address 40, Multicast address 16, and/or all broadcast messages. Language 
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filtering capability is optional in the inventive device and can be omitted with no adverse 
effect on the overall device. 

The filtering process will be described in greater detail below. As a general 
matter, the filters in the inventive device, if enabled, will cause the device to save only 
the messages in which the address filter is enabled and in which the filter value matched 
with a predetermined data value. Another feature in the invention is that the filtering 
process is selectable; that is, the device can select whether to store all messages in the 
data stream received by the CMP-FPGA or only messages that correspond with 
predetermined message filtering parameters. The inventive device also preferably has 
single packet capture capability, where a single packet is captured and stored in RAM. 
Other functions in a preferred embodiment of the inventive device include cyclic 
redundancy checking (CRC) calculation and a message validation function that checks a 
header (e.g., a 4-byte MPEG header) before continuing with processing. The device 
preferably also has an error processing function that indicates the presence of any packet 
errors via error flags. 

Data storage according to the claimed invention preferably uses a dual port RAM 
as the memory, with the message buffers being 2K or 8K circular buffers (the details of 
which will be described below), depending on the mode in which the inventive device is 
operated. For simplicity, the embodiment described below with respect to the Figures is 
designed to extract messages and packets from up to 32 different designated packet 
identifier sources out of an MPEG input stream. With this example, the device will use 
32 processors when operated in the 2K mode and 20 processors when operated in the 8K 
mode. Of course, the invention is not limited to any specific number of processors or any 
particular message buffer size; these details can be modified without departing from the 
scope of the invention. 

Figure 1A is a representative block diagram illustrating the configuration of one 
embodiment of the present invention, and Figure IB illustrates a CPU interface that 
controls the reading and writing of data to and from the CMP-FPGA 100. In this 
example, the CMP-FPGA 100 is designed to extract messages from up to 32 different 
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packet identifiers from a MPEG stream. The CMP-FPGA 100 may be configured as 32 
channels, with a 2K circular buffer provided for each channel or with 2K circular buffers 
for 16 channels and 8K circular buffers provided for 2 channels as the message buffer for 
storing extracted messages. The packet data input into the device 100 can be one byte 
5 wide infobus data having a data validation signal for validating bytes of data in each 
packet. This validation feature allows the input data flow to be interrupted without 
corrupting the packet. 

The CMP-FPGA 100 generally includes three modules: an input interface 102, a 
packet identifier (PID) filter 104, and a message processor 106. The message processor 

10 106 is shared by all 32 different message extraction channels and, as noted above, can 
therefore extract messages from up to 32 different packet identifiers from a data stream. 
The input interface 102 receives multiplexed data having packet identifying information 
(PID) and stream identifying information (PIDSOURCE) that uniquely identify within a 
given stream similarly named packets from different streams apart. Both the packet 

15 identifying information (PID) and the stream identifying information (PIDSOURCE) 
are necessary because packets in different streams may have the same packet identifier 
(PID), making the stream identifying information necessary for the processor to tell them 
apart. The multiplexed data preferably has already been converted into parallel packet 
data as individual bytes of data accompanied by an enable signal for validating each byte 

20 of data in the packet. As each byte is received, BYTE_CLKJEN and CRC CLK EN 
enable signals are generated from a combination of the CMP_B YTE_V ALID and 
CMP_BYTE CLK signals, as shown in Figure 2. 

Once the interface generates the BYTE_CLK_EN and CRC_CLK_EN enable 
signals, the CMPBYTEDATA and CMP_BYTE_SYNC signals are re-clocked using 

25 the generated enable signals, as shown in Figure 3. The CMP_CLKIN in this example is 
a 13.5 MHz clock. The CMP_BYTE CLK, CMP__BYTE DATA, CMP_BYTE SYNC, 
and CMP_B YTE VALID all should have a minimum of 1 1 .0 ns setup and 0 ns hold. As 
can be seen in Figure 3, the timing of the re-synchronized CMP_BYTE_DATA and 
CMP BYTE SYNC signals correspond neatly with the CMP CLKIN and 
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CMP_BYTE_CLK, as compared with the timing diagram in Figure 2. The re- 
synchronized byte data is then sent to the PID filter module 104 for additional processing. 

Next, the CMP-FPGA packet identifier (PID) filter 104 provides mode, filtering, 
enable and masking control for each message processing channel. Each channel can be 
5 independently programmed for any mode by the PID filter 104. Figure 4A is a 

representative diagram of the RAM that acts as the message buffer and Figure 4B is a 
control diagram of the PID filter 104. In this example, there are either 32 or 20 
programmable message processing channels, depending on the storage mode in which the 
CMP-FPGA 100 is operated. More particularly, there are two different storage modes 

10 that control the depth of the circular storage buffer for each channel as well as the number 
of channels are available. If the storage mode for the message buffer is set for 2K, for 
example, then all 32 channels are available with a 2K circular buffer for message storage 
associated with each channel If the mode is set for 8K, however, then only 16 channels 
are available with a 2K circular buffer for message storage, and 4 channels are available 

15 with an 8K circular buffer for message storage. 

The PID filter 104 also has two different modes, a capture mode and a message 
mode, identifying the type of data that will be stored in the message buffer. The capture 
mode allows a full packet, except for the sync byte in the packet, to be captured and 
stored in one of the channel's buffers. The capture mode may filter any bit in the 3 

20 control bytes of the MPEG header in the packet or mask any bit in the header to turn the 
masked bits into "don't care" bits. In the message mode, the messages contained in the 
packets are allowed to be processed either with or without address filtering. The address 
filtering function may be turned on or off via a control RAM interface. If the address 
filtering function is turned off, all messages received by the PID filter 104 having active 

25 packet identifiers is sent to the message processor 106 (indicated in Figure 1 as 

BYTEDATA) If the address filtering is turned on, however, only messages with one of 
four selected allowable address types will be sent to the message processor 106 as 
BYTEDATA for storage. In one embodiment, the allowable address types are the 
following: Unit address 40, Multicast 16, and Broadcast. In this example, the Broadcast 
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address type is always processed, while the other 3 address types are processed only if the 
address type has been selected and the address is defined in the CPU. 

The PID filter module provides the filter control through a single RAM having 
multiple addressed locations and that acts as the message buffer for storing messages 
5 from up to 32 different channels. The message buffer can be partitioned into two pages 
so that the CPU may write filter control information into one page while the internal 
processor uses the other page. After the CPU writes all of the filter control information 
into the message buffer, it changes the page at the timing of the sync of the incoming data 
stream. The PID filter 104 may also have a 32-stage pipeline delay to allow each of the 

10 32 different programmable PIDs to be compared with the incoming packet ID. If the 
programmed PID matches the incoming packet identifier, and 3 bit source identifier 
(PIDSOURCE), the PID RAM address count is latched. The latched data is used to 
provide the channel address to the control channel processor RAMs in the message 
processor 106. As part of the PID checking process, the entire header in the packet is 

15 checked to determine if the packet is valid. During the validation process, the packet 
being checked must meet one or more predetermined conditions, such as whether the 
error bit in the packet is inactive and whether the scramble control bits indicate that the 
packet is not scrambled. If the channel is enabled and if the packet meets the 
predetermined conditions on a channel by channel basis, the packet is sent to the message 

20 processor 1 06 for address filtering, message validation, and storage in the message 
buffer. 

If the PID filter 104 sets a packet capture mode (which will be described in 
greater detail below), the PID filter 104 validates the entire header before the capture 
function is initiated. Each control bit may be explicitly compared or, if the bit is a "don't 
25 care" bit, masked. To carry out the packet capture function, the PID filter 104 must first 
confirm that the channel is enabled, the packet capture mode is enabled and all filters 
masks are programmed. 

Referring now to Figures 5 A through 5D and Figure 6, the PID filter 104 provides 
START and END signals for the four different types of transitions moving from packet to 
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packet, processing messages. These signals are used during the header bytes (e.g., 4 
bytes in the case of MPEG packet data), which allow enough time for the PID filter 104 
to transition to the next packet for message processing. Old control variable states are 
stored and new control variable states are loaded for each channel during this time to and 
5 from the state buffer, which is separate from the message buffer described above. 

The message processor 106 extracts the desired messages from the data stream. 
As a general matter in this example, each message extraction channel has a dual function. 
The message extraction channel may be configured to extract a single packet and store it 
to the message buffer, or it may be configured to extract the messages that reside inside 

10 the packets. Messages extracted from packets may be filtered by address; alternatively, 
the address filtering function may be turned off to receive all messages that reside in the 
packet, without any filtering. 

More particularly, each one of the message extraction channels may be filtered 
according the following parameters: PID value; Unit address 40; Network address 40; 

15 Multicast 16 address; and/or all broadcast messages. Of course, other parameters may be 
incorporated into the filter if desired. The CMP-FPGA is programmable to either capture 
all messages or capture messages based on the message address filters. Each message 
extracted from the MPEG stream is stored in a circular buffer message buffer. When 
each of the 32 message channels are configured with a 2K circular buffer size, the 

20 maximum message size allowed in the 2K buffer is IK. Channels in the 8K buffer mode 
will accept messages up to 4K in size. 

The message processor 106 conducts two independent processes. The first 
process counts down a new message start pointer (NMSP) and outputs a new message 
interrupt signal (NEWMIP). The second process involves processing and storing the 

25 message itself by extracting the messages and storing them into circular buffers on word 
boundaries. Each of these processes will be described in greater detail below. 

With respect to the new message pointer process, the process is activated when a 
payload start indicator in the message processor 106 and the NMSP byte value are not 
equal to zero. If the NMSP byte value does equal zero, the message processor 106 
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bypasses the new message pointer process altogether. If the NMSP value is greater than 
the packet length, the new message pointer process will be terminated at the end of the 
packet. 

Figures 5A through 5D illustrate different boundary conditions where the data is 
5 shifted to avoid corrupting the message being processed. More particularly, Figures 5A 
and 5D illustrate shifting when a new message start point (NMSP) byte is located 
between a header portion and a body portion in the packet, while Figures 5C and 5D 
illustrating shifting when a byte left over from a previously-processed packet is inserted 
in the packet body. As can be seen in Figure 5A through 5D, the packet includes a 4-bit 

10 header 500 and a packet body 502. The operation of the message processor 106 is 

initiated by one of three conditions. One condition initiates message processor operation 
when (1) a "go to message processor" (GO_MP) signal is high; (2) the channel 
corresponding to the packet being processed is enabled; (3) a payload start signal is high; 
and (4) the NMSP byte equals zero. The message processor 106 may also begin 

15 operation simply when the NEWMIP signal is high. Alternatively, the message processor 
106 begins operation when (1) a message in progress signal MEPO is high; and (2) the 
GO MIP signal is high. 

The message processor also has several priority interrupts that restart message 
processing. The top priority interrupt occurs if the read pointer and write pointer ever 

20 overlap the 2K / 8K circular message buffer. Before the address of the 2K / 8K message 
buffer is overlapped, the process will immediately exit, discard the current message in the 
buffer, and send an overflow error signal to the PID filter 104. 

The next types of interrupt is an end of packet indicator PKTJEND signal. The 
PKT_END signal is an output signal after selecting one of four different PKT_END 

25 signals PKT_END 1-4, depending on the boundary condition experienced while 

processing the packet. When PKT_END 1-3 occur, all state data of the current process 
are stored in the state buffer and the state of the process is returned to idle, while when 
PKTEND 4 occurs, the old state data is written to the state buffer. Generally, when 
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PKT_END occurs, all states of the current process are stored in the state buffer and the 
process state of the message processor is returned to idle. 

In Figure 5 A, the NSMP byte is inserted in between the header 500 and the body 
portion 502 of the packet, and the GO_MIP signal is high at the location of the NSMP 
5 byte. The PKTJ3ND signal goes high at the end of the packet body, at which the CRCs 
are stored for complete messages, the state of the message processor is returned to idle, 
the message data is saved to the message buffer and the current state data is saved to the 
state buffer. Figure 5B shows a situation where there is no NSMP byte at the point that 
the GOJMIP signal is high; in this situation, the packet body 502 is pushed forward one 

10 byte and the PKTEND signal goes high when, as in the Figure 5 A, the message 
processor reaches the last byte of the packet body 502. Figure 5C shows a situation 
where a byte from a previous packet has not been processed yet before the new packet is 
read; in this case, the byte from the previous packet is inserted in between the header and 
body of the new packet, pushing the bytes in the new packet forward two bytes. Figure 

15 5D shows a similar situation as Figure 5C except that a NMSP is inserted in between the 
header and the byte from the previous packet. Note that in Figure 5D, there are two 
PKTEND signals that initiate writing of state data to the state buffer. The PKTJEND 2 
signal corresponds to the end of the packet and, like the examples above, causes storage 
of the CRCs for complete messages, saving the current state data to the state buffer, and 

20 setting the state of the message processor back to idle. The PKT_END 4 signal, however, 
initiates writing of the state data for the previous packet to the state buffer as well. 

Another type of process interruption occurs when the message process receives a 
new message interrupt signal (NEWMIP) from the first process, which counts down the 
new message start pointer NMSP, while a packet is being processed by the second 

25 process. This interrupt can occur any time that a packet is being processed for a message. 
If NEWMIP occurs as a message being processed, then the current message will be 
discarded, a packet error flag will be set, and a new message process will be started. If 
no message is being processed or a message extraction has just successfully completed 
when the NEWMIP occurs, then a new message will start with no errors generated. 
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The process states of the message in the inventive system is shown in Figure 6. 
States corresponding to each packet will be stored in a state buffer as it is processed. 

The first process state 600 in the message processor begins by moving between an 
idle state 602 and a state in which the new message start pointer NSMP is counted down 
5 604. Once the NMSP byte reaches zero, the new message interrupt NEWMIP signal is 
output from the count down state 604 in the message processor and transitions the 
message processor into its second process state 606, which again starts as an idle state 
608. The message processor uses the NMSP to find the start of a new message at state 
610. When the start of the new message is located, all of the information about the 

10 message (e.g., message length, and address type) is extracted. The message processor 
then compares the address type with predetermined expected address types and jumps to 
the address filter state 612 if corresponding address types match; if not, the message 
processor waits for the PKTEND signal and returns to idle once it is received from the 
PID filter. The addresses are compared with the filter addresses during the address filter 

15 state 612, and if an address filter matches the address, then the processor jumps to the 
process message state 614; if not, the message processor waits for the PKT_END signal 
and returns to idle 108 once it is received. 

In the process message state 614, the message length is counted down to the 4 
bytes of CRC data, and then the message processor jumps to the verify CRC state 616. 

20 The calculated CRC is compared with the CRC at the end of the extracted message. If 
they match, then the message processor has extracted the message successfully. 

Once the message is extracted and verified at states 614 and 616, respectively, the 
message processor begins searching for a new message in the data stream at state 618. If 
no new message is found, the message processor waits for the PKT_END signal and 

25 returns to the idle state 608 once it is received. If the message processor does locate a 

new message, however, the NEWMIP signal goes high and the message processor returns 
to the message length state to restart the message extraction process for the new message. 
Note that during any of these states, a NEWMIP signal can cause the message processor 
at any time to leave the current state and return to the message length state 610, 
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effectively abandoning processing of the message and resetting the state machine to 
initiate processing of a new message. 

As can be seen in the Figure, the message processor also has an alternative packet 
capture control function at state 620, where the message processor stores only one packet 
5 in the state buffer and will not capture another packet until the previous packet state data 
has been read out of the state buffer. More particularly, the alternative packet capture 
function 620 allows the CPU to turn off message processing of any channel, capture a 
single packet, and store the captured packet to the message buffer. During this function, 
every control bit in the header bytes can be either be compared or masked; therefore, 

10 packets may be uniquely identified through a combination of compare bits and masks. 
The captured packet is preferably stored starting at address 0 of the message buffer 
associated with the captured packet's channel. During the alternative packet capture state 
620, another packet will not be captured until the first packet has been read. Any 
messages not read or not complete when the packet capture function is initiated will be 

15 deleted and will not be stored in any of the buffers. 

The "one shot" packet capture function 620 can be enabled on any of the 
channels. This mode selects a packet by filtering any bit in the 4 bytes of the packet 
header. These bits may be exact matches or the bits can be masked so they are ignored 
during the compare process in selecting a packet to save to the state buffer. 

20 Note that for every state, the message processor may also log the message write 

pointer WRPTR and check to make sure that the write pointer and the address pointer do 
not overlap. If they do overlap, the message processor indicates an address pointer 
(ADRPTR) crash and returns to the idle state without saving the message. Thus the 
message processor returns to idle from any state when it receives either a PKT_END 

25 signal or a ADRPTR crash indication. 

Figure 7 illustrates the state buffer and address filter shift register for the message 
processor 106. As can be seen in Figure 6, the CMP-FGPA 100 has only one message 
processor state machine 700, which is shared between 32 different channels. The 32 
different channels are able to share the single processor 104 by saving every state of the 
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message processor state machine 700 and all partially completed calculations in the state 
buffer. In this specific example, the state buffer is 32 locations deep to accommodate the 
32 different channels and is as wide as needed to store every processing state 
corresponding with each channel. The state buffer address is latched by the latched 

5 counter value from the PID filter comparator circuit. At the end of each packet, the 

message processor stops the active state machine process (shown in Figure 6), returns the 
state to idle, and saves all states at that point in the state buffer. When a new packet is 
ready to be processed, the message processor loads all of the previous state information 
in from the state buffer and continues processing the message in the new packet, shifting 

10 data as necessary as described above and shown in Figures 5 A through 5D to avoid 
corrupting the message being processed. Further, as shown in Figure 7 below, the 
BYTE_DATA multiplexer 702 modifies the data stream being processed by multiplexing 
different shifted versions of the data stream before the stream is processed by the 
message processor and the messages saved to the state buffer. 

15 Figure 8 is a diagram of an address filter control circuit 800 in the message 

processor 104, which corresponds with the address filter state in Figure 612. As 
explained above, the address filter control circuit compares the message address type 
against any or all enabled address types. The address filter control circuit 800 also 
compares the message address against any or all programmed address values. There are 

20 four address types available to be enabled by the address filter; broadcast address types 
are always enabled, while the other three address types mentioned above (Network 
address 40, Unit Address 40, and Multicast address 16) are enabled by programming a 
channel control RAM 802, and more particularly by linking an enabled bit in the control 
RAM 802 to a particular address type. If an address type is enabled, an address 

25 corresponding to the enabled address type must also be programmed for address filtering 
to take place. During the actual filtering process, if the address type of a received packet 
is valid, the message processor state will jump from the message length state 610 to the 
address filter state 612, as shown in Figure 6. In the address filter state 612, the 
programmed addresses are compared with the message address extracted from the 
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received message in a comparator. The comparator 804 outputs are sent to a multiplexer 
806. If the comparators indicate that there is a match between the address of the received 
message and a programmed address, the message processor state machine jumps from the 
address filter state 612 to the message processor state 614. 
5 If address filtering is disabled, however, all of the messages received by the 

message processor are treated like a broadcast message and no address comparisons are 
made. Disabling address filtering can be conducted by, for example, setting all of the 
control RAM 802 bits to 0. In this case, the state machine immediately jumps from the 
address filter state 612 to the message processor state 614 without any address 

10 comparisons taking place. 

Figure 9 shows a CRC and error checking circuit 900 in the message processor 
1 06, which corresponds with the CRC verify state 616 shown in Figure 6. During the 
processing of a message, each byte of the message is used to calculate a CRC. If the 
calculated CRC value matches the CRC embedded in the message, the message is 

15 deemed valid and the message processor proceeds to complete storage of the valid 

message and write the message buffer pointers corresponding to the valid message. Note 
that because all of the channels share the same CRC verification circuit 900, the CRC 
generator 902 and the CRC shift registers 904 in the CRC verification circuit 900 should 
be loadable. More particularly, the CRC circuit 900 should be able to stop message 

20 processing for one channel, save the state data corresponding to that channel in the state 
buffer, load and process a new channel, and resume processing of the previous channel 
without corrupting any messages or losing message information. 

To prevent loss of data while the message buffer is being read, the CPU 
preferably follows a process as illustrated in the flowchart in Figure 10. Before reading 

25 the message buffer, it is assumed that the control channel processor has been reset and the 
message buffer is empty. Also, in this example, it is assumed that any incoming 
messages have already passed the address filtering and CRC verification stages 
successfully. When a control message processor interrupt signal is detected as being 
active low, the CPU has the option to mask the interrupt while processing messages. 
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When a new message arrives at a particular channel, a message ready flag MSG_RDY 
associated with that particular channel goes high to indicate that the channel has a stored 
message. The CPU identifies all of the channels having stored messages at step 1000 and 
initiates a read request to read the read pointer RDPTR of the highest priority channel 
5 first at step 1002. This transfers the current write pointer into the WRPTR register. 

If, for a given channel, the write pointer WRPTR was being updated at the same 
time that the read request is being processed, the MSG_RDY flag for that channel will 
not be reset at step 1004. If, however, the write pointer is stable, the MSG_RDY flag for 
that channel will be reset at step 1006. 

10 The CPU then reads the WRPTR register corresponding to the same channel as 

the read request from previous step 1002. The CPU uses its internal value for the read 
pointer RDPTR plus a channel offset to locate a place to start reading the first message 
out of the message buffer at step 1008. Each message's length is determined by a 
message length value embedded in the message. There may be several messages in the 

15 buffer, and the CPU calculates the new value of the read pointer RDPTR from the old 
RDPTR value and the embedded message length value. The WRPTR value is used to 
retrieve all the messages in the channel being read and to calculate the RDPTR value it 
needs to write back to the control message processor. 

After all the messages for that channel have been read from the message buffer, 

20 the CPU writes the RDPTR to the control message processor and checks to see whether 
there is another channel that contains messages to be read at step 1010. If so, the CPU 
moves to another channel and repeats steps 1002 through 1008 until all the messages 
have been read. Once all of the messages have been read, the CPU unmasks the interrupt 
at step 1012 and checks the interrupt status at step 1014. If the interrupt is still active low 

25 at the time it is unmasked, it indicates that new messages have been received during the 
previous message processing round. If this occurs, the CPU returns to step 1000 to 
initiate a new message processing round. If the CMP interrupt is inactive high at step 
1 014, however, it indicates that there are no new messages to be processed in any of the 
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channels. In this case, the CPU can rest while waiting for the channels to receive new 
messages. 

Referring now to Figure 11, the MSG_RDY flags and the interrupt signal 
mentioned above with respect to Figure 10 are generated by writing to a WRPTR RAM. 
5 The write pointer WRPTR is written by the message processor 104 at the completion of 
each message to the RAM address associated with its channel. Each of the 32 channels 
has its own associated MSG_RDY flag control circuit. The interrupt signal is generated 
by an OR gate that receives all the MSG_RDY signals as inputs, as can be seen in the 
Figure. When the CPU is interrupted, it reads a MSG_RDY register to determine which 

10 channels have messages ready. During the processing of each message, the CPU requests 
a read of the write pointer WRPTR. The WRPTR interface synchronously transfers the 
data into the WRPTR JHOLD_REG to be read by the CPU, and during this transfer the 
MSG_RDY flag is reset. If a new message is received during the data transfer, however, 
the MSG_RDY flag will not be reset. Processing of each message is completed by 

15 writing the read pointer RDPTR with the address location of the end of the message 
reading process. 

Figure 12 illustrates a message error control circuit in the message processor 104. 
As noted above, the message processor identifies lost messages either due to corrupt 
packets or to buffer overflow. To accomplish this, the circuit shown in Figure 12 

20 includes two error circuits 1200, 1202 for each of the 32 channels. One error circuit 1200 
generates a flag that identifies messages lost due to corrupt packets, and the other error 
circuit 1202 generates a flag that identifies messages lost due to overflow in the message 
buffer. These registers are set when an error is detected and cleared after the CPU has 
read the status of the registers. 

25 Thus, the inventive system is a multi-tasking, multi-channel message extractor, 

expandable to any depth by increasing the depth of the RAM to obtain more message 
extraction. More particularly, the inventive system can extract and process a plurality of 
messages portions contained in packets in a multi-tasking fashion by using two separate 
buffers to store extracted message information and state data corresponding to the 
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extracted message information, each buffer having a plurality of locations corresponding 
to a plurality of channels. This capability allows the inventive system to capture, extract, 
and assemble multiple complete messages from packet data in multiple streams. 

A preferred multi-tasking message extractor according to the invention should 

5 take into account a number of parameters to achieve full functionally in a head-end 
application or any other application in which the inventive device will be used. For a 
typical re-multiplexing application, for example, there are more than 600 control states 
that should be stored and loaded in proper sequence for every packet in the data stream. 
Further, there preferably are 4-byte wide time slots in which to unload an old message in 

10 the process of being extracted, and in which to re-load an active message to be extracted. 
The invention is best implemented in a distributed RAM type FPGA/ASIC (ie. Xilinx, 
ORCA), although conversion to an ASIC is an option that would fall under the scope of 
the invention. 

Those of skill in the art will understand that the inventive message extractor can 
15 be modified and altered in light of the foregoing disclosure without departing from the 
scope of the invention. For example, although the inventive message extractor has been 
described as extracting message from a data stream in the MPEG digital format, the 
extractor can be modified to extract messages from data streams in other formats, both 
currently known and subsequently developed. Additionally, the inventive message 
20 extractor can be used to extract messages from a signal, such as an MPEG signal, within 
a larger digital broadcast scheme, such as the Digital Video Broadcast (DVB) format 
(which uses the MPEG format as its video format). Thus, the present invention is not 
intended to be limited by any of the specific examples provided herein. 

It should be understood that various alternatives to the embodiments of the 
25 invention described herein may be employed in practicing the invention. It is intended 
that the following claims define the scope of the invention and that the method and 
apparatus within the scope of these claims and their equivalents be covered thereby. 
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CLAIMS 

WHAT IS CLAIMED IS: 



1 1 . An apparatus for extracting messages from a digital data stream containing 

2 messages, comprising: 

3 a message processor that receives the digital data stream and extracts message 

4 portions from the digital data stream; 

5 a first buffer having a plurality of locations associated with a plurality of channels 

6 to store the extracted message portions; and 

7 a second buffer having a plurality of locations associated with the plurality of 

8 channels for storing state data corresponding to the extracted message portions. 

1 2. The apparatus of claim 1 , further comprising a central processing unit 

2 interface for coupling the apparatus to a central processing unit. 

1 3. A device for extracting messages from a data stream, comprising: 

2 an input interface that receives packet data in the data stream; 

3 a packet identifier filter coupled to the input interface to selectively filter the 

4 packet data, the packet identifier filter having a central processing unit (CPU) interface to 

5 allow communication between the device and a CPU; 

6 a message processor that receives the selectively filtered packet data from the 

7 packet identifier filter and extracts message portions from the packet data; 

8 a first buffer having a plurality of locations associated with a plurality of channels 

9 to store the extracted message portions; and 

10 a second buffer having a plurality of locations associated with the plurality of 

1 1 channels for storing state data corresponding to the extracted message portions. 

1 4. The device of claim 3, wherein the input interface converts the packet data 

2 into parallel packet data. 
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1 5. The device of claim 4, wherein the parallel packet data is sent to the 

2 packet identifier filter with a enable signal to validate byte data in the packet. 

1 6. The device of claim 5, wherein the input interface generates at least one 

2 clock enable signal to resynchronize the byte data. 

1 7. The device of claim 3, wherein the packet identifier filter provides at least 

2 one selected from the group consisting of mode control, filtering control, enable control 

3 and masking control for each channel in the message processor. 

1 8. The device of claim 7, wherein the mode control includes selecting one of 

2 a plurality of storage modes, each storage mode corresponding to a buffer size for the 

3 first buffer. 

1 9. The device of claim 7, wherein the mode control includes selecting one of 

2 a capture mode, where the packet data is stored in the first buffer as a full packet without 

3 a sync byte, and a message mode, where messages in the packet data are allowed to be 

4 processed. 

1 10. The device of claim 7, wherein the filtering control includes selecting 

2 whether address filtering is turned on or off, and wherein all messages in the packet data 

3 are processed when the address filtering is turned on and selected messages in the packet 

4 data are processed when the address filtering is turned off. 

1 11. The device of claim 3, wherein the filter module has a pipeline delay to 

2 allow the packet identifier of an incoming packet to be compared with at least one 

3 predetermined packet identifier. 
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1 12. The device of claim 3, wherein the filter module validates the incoming 

2 packet by checking a header in the incoming packet with at least one predetermined 

3 condition. 

1 13. The device of claim 3, wherein the message processor conducts a first 

2 process to find a start of a new message in the packet data and a second process to extract 

3 and store the message. 

1 14. The device of claim 3, wherein the first buffers are circular buffers. 

1 15. The device of claim 14, wherein the first buffer includes 32 available 

2 channels each with a 2K buffer for message storage. 

1 16. The device of claim 14, wherein the first buffer includes 16 channels with 

2 a 2K buffer and 4 channels with an 8K buffer for message storage. 

1 17. The device of claim 3, wherein the message processor includes: 

2 a processor state machine shared between the plurality of channels, wherein the 

3 state data from the processor state machine is stored in the second buffer; 

4 an address filter control circuit; and 

5 a verification circuit that calculates a verification code and compares the 

6 calculated verification code with an embedded verification code in the message portion in 

7 the packet data. 

1 18. The device of claim 1 7, wherein the message processor further includes an 

2 alternative packet capture control that stops message processing for a single channel and 

3 captures a single packet for storage in the first buffer. 
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1 19. The device of claim 17, further comprising a buffer control that controls 

2 CPU operation while the at least one of the first and second buffers is being read. 

1 20. The device of claim 19, further comprising a message ready interrupt 

2 control coupled to the buffer control, wherein the message ready interrupt control 

3 generates signals for determining which channels have messages that are ready for 

4 processing when the CPU is interrupted based on state data in the second buffer. 

1 21. The device of claim 17, further comprising a message error interface for 

2 identifying the presence of lost messages. 

1 22. The device of claim 21, wherein the message error interface includes a 

2 first error circuit that identifies messages lost due to corrupt packets and a second error 

3 circuit that identifies messages lost due to first buffer overflow. 

1 23. The device of claim 22, wherein the first and second error circuits are 

2 provided for each one of said plurality of channels. 

1 24. A method for extracting messages from a data stream, comprising: 

2 receiving packet data in the data stream; 

3 selectively filtering the packet data; 

4 extracting at least a portion of a message from the packet data; 

5 storing said at least a portion of the message in a first buffer associated with said 

6 message processor; and 

7 storing state data corresponding with said at least a portion of the message in a 

8 second buffer. 

1 25. The method of claim 24, further comprising the step of converting the 

2 packet data into parallel packet data. 
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1 26. The method of claim 24, further comprising the step of providing at least 

2 one selected from the group consisting of mode control, filtering control, enable control 

3 and masking control for each channel in the message processor. 

1 27. The method of claim 26, wherein the mode control step includes selecting 

2 one of a plurality of storage modes, each storage mode corresponding to a buffer size. 

1 28, The method of claim 26, wherein the mode control includes selecting one 

2 of a capture mode, where the packet data is stored in the first buffer as a full packet 

3 without a sync byte, and a message mode, where messages in the packet data are allowed 

4 to be processed. 

1 29. The method of claim 26, wherein the filtering control step includes 

2 selecting whether address filtering is turned on or off, and wherein the method includes 

3 the steps of processing all messages in the packet data when the address filtering is turned 

4 on and processing selected messages in the packet data when the address filtering is 

5 turned off. 

1 30. The method of claim 24, further comprising the step of delaying the data 

2 stream to allow the packet identifier of an incoming packet to be compared with at least 

3 one programmed packet identifier. 

1 31. The method of claim 24, further comprising the step of validating the 

2 incoming packet by checking a header in the incoming packet with at least one 

3 predetermined condition. 

1 32. The method of claim 24, further comprising the steps of: 

2 calculating a verification code; and 



80113-0103 (D2373) 



3 comparing the calculated verification code with an embedded verification code in 

4 the message in the packet data. 

1 33. The method of claim 32, further including the steps of: 

2 selectively stopping message processing for a single channel; and 

3 capturing a single packet for storage in the first buffer. 

1 34. The method of claim 33, further comprising the step of generating at least 

2 one signal for determining which channels have messages that are ready for processing 

3 when the CPU is interrupted. 

1 35. The method of claim 32, further comprising the step of identifying the 

2 presence of lost messages due to at least one of corrupt packets and buffer overflow. 
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ABSTRACT 

An apparatus and method for extracting messages from a data stream has multi- 
tasking capabilities for accommodating a greater number of data streams and for 
combining data from different streams. The message extractor includes a packet 
5 identifier filter, a control message processor, and two buffers, each buffer divided into a 
plurality of address locations associated with a plurality of channels. One buffer is used 
to store extracted message portions, and the other buffer is used to store state data 
corresponding to the extracted message portions. The control message processor includes 
a single message processor that is shared by all of the message extraction channels 

10 associated with the device. As message portions are filtered and captured, they are stored 
into the first buffer, while the state data is stored in the second buffer. As additional 
message portions are received, the system uses identifying data in the data stream to 
match new message portions with message portions that have already been received and 
stored to form complete messages. A multi-tasking message extractor reduces the cost of 

15 performance by only requiring one message extractor attached to less expensive RAM 
rather than increasing the number of message extractors themselves. 
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